Skip to content

Conversation

@tristan-f-r
Copy link
Collaborator

@tristan-f-r tristan-f-r commented Aug 31, 2025

Closes #297. [See #297 for extra motivation of the containers key beyond the diamond dependency reason below]

This is 1/2 PRs being extracted from #329 to make it easier to add testing to dsub. The second PR is #390. (See the note after the horizontal break)

[See the diff without whitespace changes from config indentation]

I've avoided splitting this PR up before since the extra file is motivated by #329: specifically, we move ContainerSettings to container_schema.py instead of keeping it in schema.py to prevent the future dependency diamond of:

  • containers.py depends on the schema for getting extra container settings (the follow-up PR above is going to refine containers.py's dependency on the schema by specifically only making it depend on container_schema.py)
  • [algorithm].py, because of run_containers, depends on containers.py
  • schema.py will, thanks to feat!: typed PRA#run #329, depend on [algorithm].py for all algorithms.

I want to be able to pass a more rich suite of options to run_container_dsub (specifically, local, to specify that dsub should be mocked with docker as specified in dsub's documentation), which causes a strange dsub_local parameter to be propagated up all the way to run_container. Instead of adding this parameter or making an auxiliary object to pass both parameters in, it seemed better to reuse the object we were reading out of the global config anyway (we do this all over containers.py anyway for container parameters, so it might be better overall to pass them in as a parameter).

@tristan-f-r tristan-f-r added the infrastructure misc. changes made to SPRAS itself label Aug 31, 2025
@tristan-f-r tristan-f-r mentioned this pull request Aug 31, 2025
6 tasks
Copy link
Collaborator

@agitter agitter left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The contributing guide will also need updates.

@read-the-docs-community
Copy link

read-the-docs-community bot commented Sep 6, 2025

Documentation build overview

📚 spras | 🛠️ Build #30059909 | 📁 Comparing 9eb8c90 against latest (615e6fb)


🔍 Preview build

Show files changed (6 files in total): 📝 6 modified | ➕ 0 added | ➖ 0 deleted
File Status
genindex.html 📝 modified
htcondor.html 📝 modified
contributing/index.html 📝 modified
fordevs/spras.config.html 📝 modified
fordevs/spras.html 📝 modified
tutorial/advanced.html 📝 modified

@tristan-f-r
Copy link
Collaborator Author

tristan-f-r commented Sep 25, 2025

3cadfc4 was the only change necessary in contributing.rst to the best of my knowledge.

@tristan-f-r tristan-f-r added the P-medium medium prirotity; this is needed for some external service or another PR label Sep 25, 2025
@github-actions github-actions bot added the merge-conflict This PR has merge conflicts. label Oct 3, 2025
@github-actions github-actions bot removed the merge-conflict This PR has merge conflicts. label Oct 4, 2025
@github-actions github-actions bot added the merge-conflict This PR has merge conflicts. label Oct 13, 2025
@github-actions github-actions bot removed the merge-conflict This PR has merge conflicts. label Oct 14, 2025
@tristan-f-r tristan-f-r added the tuning Workflow-spanning algorithm tuning label Oct 14, 2025
@tristan-f-r
Copy link
Collaborator Author

This has been tagged with tuning because it is a dependency of #321.

@tristan-f-r tristan-f-r requested a review from ntalluri October 24, 2025 20:07
Copy link
Collaborator

@agitter agitter left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks like previous review comments were addressed.

The hash_level usage is still unintuitive to me, but I trust it will make more sense once I see the future changes.

@agitter agitter merged commit c3b02cd into Reed-CompBio:main Oct 24, 2025
19 checks passed
@tristan-f-r tristan-f-r deleted the container-schema-move branch October 24, 2025 22:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

infrastructure misc. changes made to SPRAS itself P-medium medium prirotity; this is needed for some external service or another PR tuning Workflow-spanning algorithm tuning

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[config] containers

2 participants